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AMENDMENTS TO THE CLAIMS 

Please amend the claims as shown below, with insertions indicated by underlining and 
deletions indicated by strikethrough and/or double bracketing. 

1 . (Currently amended) A method of evaluating grammars associated with a voice portal on 
a portal server , said method comprising: 

generating a test input for a current grammar of the voice portal, the test input including a 
test pattern; 

providing the test input to the voice portal on the portal server using a voice server ; 

analyzing tho test patt e rn with r e spect to a set of activ e grammars corr e sponding to th e 
curr e nt grammar with a sp ee ch r e cognition engine in th e voic e portal, tho curr e nt grammar being 
on e grammar of th e sot of activo grammars; and 

deriving a receiving at least one measure of how distinguishable the current grammar is 
from other grammars of [[the]] a set of active grammars that are active when the current 
grammar is active based at least in part on [[the]] analysis of the test pattern with respect to the 
set of active grammars, the current grammar being one grammar of the set of active grammars; 
and 

determining whether to modify the current grammar based at least in part on the at least 
one measure . 

2. (Currently amended) The method of claim 1 , wherein doriving a the at least one measure 
of how distinguishable the current grammar is from other grammars of the set of active 
grammars includes deriving a confidence level and a set of n-best results for the test input, and 
wherein the method further comprises comparing the confidence level and set of n-best results 
for the test input with an expected value to assess the at least one measure of how distinguishable 
the current grammar is from other grammars of the set of active grammars. 

3 . (Currently amended) The method of claim 1 , further comprising modifying the current 
grammar to create a modified grammar if the d e rived at least one m easure deviat e s from a pre 
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dotormin e d rang e indicates that the current grammar is not sufficiently distinguishable from the 
other grammars of the set of active grammars . 

4. (Currently amended) The method of claim 3, further comprising: 

(i) generating a test input for the modified grammar, the test input including a test 
pattern for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal on the portal 
server using the voice server ; 

(iii) — analyzing th e t e st patt e rn for th e modified grammar with resp e ct to a set of active 
grammars corr e sponding to tho modifi e d grammar with th e spooch r e cognition e ngin e in th e 
voice portal, th e modified grammar b e ing one grammar of th e set of active grammars 
corr e sponding to th e modifi e d grammar; 

(iv) (Hi) d e riving receiving at least one [Tall measure of how distinguishable the 
modified grammar is from other grammars of [[the]] a set of active grammars corresponding to 
that are active when the modified grammar is active, the modified grammar being one grammar 
of the set of active grammars that are active when the modified grammar is active ; and 

(¥){iv) re-modifying the modified grammar and repeating steps (i) through (iv) (in) until 
the at least one m easure of how distinguishable the modified grammar is from other grammars of 
the set of active grammars corr e sponding to that are active when the modified grammar is active 
doer , not deviat e from a pr e d e t e rmin e d rang e indicates that the modified grammar is sufficiently 
distinguishable from the other grammars of the set of active grammars that are active when the 
modified grammar is active . 

5 . (Currently amended) The method of claim 1 , further comprising modifying the test 
pattern to emulate one or more user voices prior to e ntering providing the test input inte to_the 
voice portal. 
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6. (Currently amended) The method of claim 1, further comprising modifying the test 
pattern to emulate the influence of one or more communications network qualities prior to 
ent e ring providing the test input kite tojhe voice portal. 

7. (Currently amended) A computer-readable storage medium encoded with instructions 
which, when executed by a computer, cause the computer to perform a method of evaluating 
grammars associated with a voice portal, the method comprising: 

generating a test input for a current grammar of the voice portal, the test input including a 
test pattern; 

providing the test input to the voice portal; 

analyzing th e t e st patt e rn with r e sp e ct to a set of active grammars corr e sponding to th e 
curr e nt grammar with a sp ee ch r e cognition e ngine in th e voic e portal, th e current grammar b e ing 
on e grammar of the s e t of activ e grammars; and 

d e riving a receiving at least one measure of how distinguishable the current grammar is 
from other grammars of [[the]] a set of active grammars that are active when the current 
grammar is active based at least in part on [[the]] analysis of the test pattern with respect to the 
set of active grammars, the current grammar being one grammar of the set of active grammars; 
and 

determining whether to modify the current grammar based at least in part on the at least 
one measure . 

8. (Currently amended) The computer-readable storage medium of claim 7, wherein 
deriving a the at least one measure of how distinguishable the current grammar is from other 
grammars of the set of active grammars includes d e riving a confidence level and a set of n-best 
results for the test input, and wherein the method further comprises comparing the confidence 
level and set of n-best results for the test input with an expected value to assess the at least one 
measure of how distinguishable the current grammar is from other grammars of the set of active 
grammars. 
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9. (Currently amended) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the current grammar to create a modified grammar if the 
derived at least one m easure doviatoa from a pro dotorminod range indicates that the current 
grammar is not sufficiently distinguishable from the other grammars of the set of active 
grammars . 

1 0. (Currently amended) The computer-readable storage medium of claim 9, wherein the 
method further comprises: 

(i) generating a test input for the modified grammar, the test input including a test 
pattern for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal; 

(iii) analyzing the t e st pattern for the modifi e d grammar with roap e et to a sot of active 
grammars corresponding to th e modifi e d grammar with tho op ee oh recognition ongine in th e 
voic e portal, th e modifi e d grammar b e ing on e grammar of tho sot of activo grammars 
corr e sponding to the modifi e d grammar; 

{iv Xiii) deriving a receiving at least one measure of how distinguishable the modified 
grammar is from other grammars of [[the]] a set of active grammars corr e sponding to that are 
active when the modified gramma r is active, the modified grammar being one grammar of the set 
of active grammars that are active when the modified grammar is active ; and 

<Wiv) re-modifying the modified grammar and repeating steps (i) through Ov) (iii)_until 
the at least one measure of how distinguishable the modified grammar is from other grammars of 
the set of active grammars corr e sponding to that are active when the modified grammar is active 
H<w, nnt deviate from a pre determined rang e indicates that the modified grammar is sufficiently 
distinguishable from the other grammars of the set of active grammars that are active when the 
modified grammar is active . 

1 1 . (Currently amended) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the test pattern to emulate one or more user voices prior to 
ontering providing the test input into to the voice portal. 
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12. (Currently amended) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the test pattern to emulate the influence of one or more 
communications network qualities prior to e nt e ring providing the test input into tojhe voice 
portal. 

13. (Currently amended) A system for evaluating grammars of a voice portal executing on a 
portal serve r having a sp ee ch r e cognition e ngin e, the system comprising: 

an analysis interface for extracting a current grammar from a set of active grammars of 
the voice portal the current grammar being one grammar of the set of active grammars; 

a test pattern generator for generating a test input for eaeh the current grammar of a s e t of 
current grammars of the voic e portal , the test input including a test pattern; 

a text-to-speech engine on a computer for entering each the test patt e rn input into the 
voice portal; 

a results collector for analyzing eaefe the test patt e rn input entered into the voice portal 



curr e nt grammar for a r e sp e ctive test pattern, the curr e nt grammar b e ing on e grammar of th e s e t 
of active grammars ; and 

a results analyzer for deriving a set of statistics indicative of how distinguishable eaeh the 



of active grammars. 

14. (Currently amended) The system of claim 13, wherein the set of statistics includes a 
confidence level and a set of n-best results for each the test input, and wherein the results 
analyzer is configured to compare the confidence level and set of n-best results for each the test 
input with an expected value to assess how distinguishable each the_current grammar of th e set of 
current grammars is with r e sp e ct to is from other grammars of its corresponding the set of active 




against [[a]] the set of active grammars corr e sponding to the 



current grammar of th e s e t of curr e nt gram 



is from other grammars of the corresponding set 



grammars. 



1723810.1 



Application No. 10/733,995 Docket No.: N0484.70571US00 

Reply to Office Action of July 14, 2009 
Page 7 of 17 

15. (Currently amended) The system of claim 13, wherein the test pattern generator is 
configured to modify each the test pattern to emulate one or more user voices prior to entering 
the test input into the voice portal. 

1 6. (Currently amended) The system of claim 1 3, wherein the test pattern generator is 
configured to modify each the test pattern to emulate the influence of one or more 
communications network qualities prior to entering the test input into the voice portal. 



17. (Cancelled) 
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